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Abstract 



, We prove uniform convergence results for the integrated periodogram of a weakly dependent time series, 

namely a law of large numbers and a central limit theorem. These results are applied to Whittle's parametric 
estimation. Under general weak-dependence assumptions we derive uniform limit theorems and asymptotic 
normality of Whittle's estimate for a large class of models. For instance the causal 9-weak dependence 
property allows a new and unified proof of those results for ARCH(cxd) and bilinear processes. Non causal 
^ I 77-weak dependence yields the same limit theorems for two-sided linear (with dependent inputs) or Volterra 

0^ . processes. 
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\ 1 Introduction 
g, 

J~J ' Parametric estimation from a sample of a stationary time series is an important statistic problem both for 
^ . theoretical research and for its practical applications to real data. Whittle's approximation likelihood estimate 
ITa \ is particularly attractive for numerous models like ARM A, linear processes, etc. mainly for two reasons: first, 
. Whittle's contrast does not depend on the marginal law of the time series but only on its spectral density, and 
\ second, its computation time is smaller than other parametric estimation methods such as exact likelihood. 
Numerous papers have been written on this estimation method after Whittle's seminal paper and in particular 
Hannan (1973), Rosenblatt (1985), and Giraitis and Robinson (2001), established, respectively, the asymptotic 
normality for Gaussian and causal linear, strong mixing and ARCH(cx)) processes. The case of long range 
dependent processes, which is not considered here, was studied by Fox and Taqqu (1986), and Giraitis and 
Surgailis (1990) (note also that in a semi-parametric frame, Robinson (1995) and recently Dalla et al. (2006) 
proposed an estimator of the long-memory parameter based on local Whittle estimation). The main goal of 
the present paper is to provide a unified treatment of this asymptotic normality for a very rich class of weakly 
dependent time processes, including those previously mentioned, but also some never studied non causal or 
non linear processes. 

More precisely, let X — {Xk)ki£Z be a zero mean fourth-order stationary time series with real values. De- 
note by {R{s))s the covariogram of X, and by (K4^{i,i, k))ij^k the fourth cumulants of X defined by 

R{s) = Gov {Xo,X,)^]K {XqXs), for s e Z, 
K4{i,j, k) = "RXoXiXjXk - ¥.XoXi¥.XjXk - KXoXj¥.X^Xk - ¥.XoXkEX,Xj, for (i, j, k) G I?. 
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We will use the following assumption on X 



Assumption M: X is such that 



7 = ^i?(£)^<oo and = '^^\ni{i,j,k)\ < oo. (1) 

t& i,j,k 



The periodogram of X is 

2 
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for A e [—• TT, 7r[. 
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Now, let g( : M ^ IR a 27r-periodic function such that g G L^([— tt, 7r[) and define 

/TT 
gf(A)/„(A) dA, the integrated periodogram of X 
-TT 

and J{g) = C g{\)f{\)d\, 

J — v 

with / denoting the spectral density of X (that exists and is in L^([— tt, 7r[) from Assumption M) defined by 

■^(^) = ^E^(^)e''^ forAe [-7r,7r[. 



27r 

feez 

_^ ^ (n— /i:)An 

Recall that /„(A) = ^ X! Rn{k)e-^^^ with ^„(A;) = - ^ XjXj+k, which is a biased estimate of 

|/c|<n j=lV(l-ft) 

Thus, the periodogram /„(A) could be a natural estimator of the spectral density; unfortunately it is not 
a consistent estimator. However, once integrated with respect to some function, its behavior becomes quite 
smoother and can allow an estimation of the spectral density. A special case of the integrated periodogram is 
Whittle's contrast, defined as a function /3 — > J„(/i/3), where is included in a class of functions depending 
on the vector of parameters /?. Whittle estimator minimizes this contrast. As a consequence, uniform limit 
theorems for the integrated periodogram Jn{') are the appropriate tools for obtaining uniform limit theorems 
for Whittle's contrast, that imply, under additional conditions concerning the regularity of the spectral density, 
limit theorems for Whittle's estimators. 



A uniform strong law of large numbers of integrated periodograms on a Sobolev-type space (included in the 
space of 27r-periodic L^-fimctions) is first established only under assumption M. Additional assumptions on the 
dependence properties of the time series have to be specified for establishing central limit theorems. Our choice 
has been to consider time series satisfying weak dependence properties introduced and developed in Doukhan 
and Louhichi (1999). Numerous reasons may explain this choice. First, this frame of dependence includes a 
lot of models like causal or non causal linear, bilinear, strong mixing processes and also dynamical systems. 
Second, they are independent of the marginal distribution of the time series. Finally, they can be easily used in 
various statistical contexts, in particular in the case of the integrated periodogram which is a quadratic form. 
These uniform limit theorems can be compared with those obtained in Dahlhaus (1988) or Mikosch and Nor- 
vaisa (1997). Roughly speaking, the presented results are obtained under weaker conditions on time series, but 
considering different functional spaces. 

Two frames of weak dependence are considered here. The first one exploits a causal property of dependence, 

the 9-weak dependence property (see Dedecker and Doukhan, 2003). Under certain conditions, the uniform 
limit theorems for integrated periodogram and asymptotic normality of Whittle's estimate are established. 
These general results are new and extend Hannan's (1973) and Rosenblatt's (1985) classical results for causal 
linear or strong mixing processes. For example, parametric and causal ARCH(oo) or bilinear processes (a 
very general class of models introduced by Giraitis and Surgailis (2002), see definition (21)) are considered; 
under certain conditions, the asymptotic normality of Whittle's estimators for those two classes of models is 
established with the same method. (The case of causal ARCE[(oo), and therefore of GARCH(p,q), was already 
treated by Giraitis and Robinson, 2001, under less restrictive conditions. However, their proof is ad hoc and 
cannot be used in a more general context). 

The second type of dependence under consideration is rj-weak dependence. This property allows to derive 
central limit theorems for non causal processes, see [2] or [19]. These results can be applied for instance, to 
two-sided linear or Volterra processes (see their definition below in Section 3). Let us remark that usual proofs 



of central limit theorems for the integrated periodogram are established by considering increments of martin- 
gales or asymptotic results for strong mixing processes, which is not a method adapted for non causal processes, 
even in the simple case of two-sided linear models. The proof of our results is a corollary of a general functional 
central limit theorem for ry-weakly dependent processes, established by using Bernstein's blocks method. Even 
if our results may be sub optimal in terms of the conditions linking the moment assumption with the decay 
rate of weak dependence of the time series, they however cover numerous models and open new perspectives 
of treatment for non causal processes. 

The paper is organized as follows. In Section 2, uniform limit theorems are presented with some applica- 
tions to time series. Section 3 is devoted to limit theorems satisfied by Whittle's estimators, that are applied 
to several examples of causal and non causal processes. Section 4 contains the main proofs, and a useful lemma 
is presented in an appendix (Section 5). 

2 Uniform limit theorems 

2.1 Notations and assumptions 

Afterwards we shall use the zero mean random variables 

Yj,k = XjXj+k-Rik), for all {j,k)&I?. 
We intend to work in a Sobolev space Hs of locally and 27r— periodic functions, defined by 

= {5 e L2([-7r, 7r[) / \\g\\n, < cx)} with H^H^,^ = ^(1 + ■ \gt\\ and s > 1/2, 

where g{X) = X^^gz 9^ '^^^^ space Hs is included in the space C* of continuous and 27r— periodic functions 
and llfiflloo = sup[_^^^[ |fif| < y/c^ ■ \\g\\Hs with 

c. = ^(l + |£|)-2^ (2) 

eel, 

As usual H'g denotes the dual of Hg with norm defined from the identity HT"!!-^' = supygy^ <i Hence if 

Ten's 

|lr||2,,= sup \T{g)\^ = J2{^ + \^\)-''-\ne''')\'- 

We study the asymptotic behavior of J„ — J uniformly in the function space Hs or equivalently as elements of 
the Hilbert space H'g. 

2.2 Uniform Strong Law of Large Numbers for the integrated periodogram 

We develop a uniform strong law of large numbers (Uniform SLLN) for the integrated periodogram {Jn{g))g- 
An important feature is that the assumptions are only stated here in terms of cumulant sums. Thus we need 
no additional assumption on the dependence of the sequence X. 

Theorem 1 (ULLN) If X satisfies Assumption M, then 

\\Jn-J\\n', ^ 0. (3) 

Remark Let X be a 4-th order causal linear process, i.e. Xn = J2k=o '^^ ^'^^ n e Z, where (Cfe)feez is a 
sequence of zero mean i.i.d.r.v. such that J2k < cxD) J2k l^fel < < Prom Rosenblatt (1985, 

p. 59), and the multilinearity of cumulants {i.e. |k4| < J2i j k jik)\ = \c4\{ kfcl)* where C4 is the 4-th 
order cumulant of {S,k)kez), then X satisfies Assumption M and therefore the previous uniform SLLN yields. 
In Mikosch and Norvaisa (1997), uniform LLN for the integrated periodogram are also proved for causal linear 
processes. The integrated periodogram is then considered on a general class of functions !F endowed with a 
pseudometric space of C^. In addition of the fourth moment condition, the assumptions arc respectively in 
Theorems 3.3 and 3.4, J2'k=o ka^ < 00 for a, uniform weak LLN and J^^i k^^^ a| < 00 for a uniform strong 
LLN. As a conclusion, the uniform strong LLN (3) is satisfied by a larger class of causal linear processes but 
the functional space Hs is different from T (with also a different distance). 



2.3 Uniform Central Limit Theorem for the integrated periodogram 

Now, we would like to establish a uniform central limit theorem (UCLT) for the integrated periodogram J„(-) 

on the space of functions TY, . Assumption M is not sufficient for such a result. The dependence between the 
terms of the time series X has to be specified, and we will consider 2 cases. Before this, under Assumption M, 
we define for any \,fjb,y& R, the bispectral density 

/4(A,M,^) = ^ £ E ^AKKDe'^^'^'^^''^) 

h — — OQ k — — OQ i— — OQ 

the matrix S = (o'^i,£^)i<ij<m) where ii are distinct integer numbers, with 

ak,e = ^ (^R{h)R{h + i-k) + R{h + £)R{h - k) + Ki{h, k,h + i)^ , (4) 

and for gi and 52 in Wg, the limiting covariance r{gi,g2) 



r(ffi,g2)=47r r g,{X)g2{X)f{X)dX + 2n f f 

J — TT TT J — ' 



9iW92itJ')UiX,-iJ,,ii)dXdii. (5) 



2.3.1 UCLT for causal time series 



This first case follows a classical methodology: the UCLT results from the finite dimensional convergence and 

the tightness of the process Z = {Zn{g))gen, where Zn(g) = \/n{Jn{g) — J{g)) for n G N* and g <E Tis- Since 
g I— > Zn{g) is a linear functional, the finite dimensional convergence is a consequence of the multidimensional 
central limit theorem for empirical covariances. 

In the sequel, for i? € Z, we will denote by Mq a a-algebra such that 

M^^^ D a {Yk,e, k<0)=a [XkXk+i, fc < 0) . 

Here a{Wi, i € I) represents the cr-algebra generated by (Wi)i£/. An example of such cr-algebra M.q^ is 
Mq ^ = a (XkQ, for a given fco € Z. The most classical of such cr-algebra is defined, for any integer p 

such that p> £, 

M^^^ =Bj, = a{Xj, j<p). (6) 

Lemma 1 Let (£1, . . . ,£m) € be arbitrary distinct non-negative integers (m G N*). Let X satisfy Assump- 
tion M and be such that 

J2 |lE {Yo,u E {YkA I mI^'^) ) I < 00 for all i€ {1, . . . ,m}. (7) 

k>0 



Then, ifT, = (cr^ ei)i<ij<m defined in (4) is a nonsingular matrix, with — > the weak convergence, 

(V^{Rn{£i)-^Rn{ii))) ^ AA„(0,S). (8) 

\ / l<i<m n— >cio 

Remark Lemma 1 is a gencrahzation of a result of Rosenblatt (1985, Theorem 3, p. 58) which asserts the 

CLT if for each i e {1, . . . , m}, f E^E {Yk^e- \ Bo)j j < 00, and this implies (7). An analogue CLT in 

k=o ^ ^ 

Hall and Heyde (1980) (Theorem 5.4, page 136) does not seem to be adapted to work out the forthcoming 

examples. 

Theorem 2 Under assumptions of Lemma 1, the Uniform Central Limit Theorem (UCLT) holds 

Zn = \/n{Jn — J) — > Z in the space H'g, (9) 

n— ^00 

with {Z{g))g(z-}i^ the zero mean Gaussian process with covariance T{gi,g2) defined in (5). 



Remark Dahlhaus (1988) and Mikosch and Norvaisa (1997) established also UCLT of the integrated pe- 

riodogram for a general class of multivariate processes with high-order spectra (inclnding certain Gaussian 
processes) and for causal linear processes, respectively. The considered functional spaces require to satisfy 
conditions close to the classical Dudley's conditions. The UCLT theorem 2 needs the simple assumption s > |, 
besides the conditions for finite dimensional convergence. Recall that assumption s > ^ is also rcqiiired for 
obtaining uniform equicontinuity, however additional dependence conditions are always needed (see, for exam- 
ple, Dedecker and Louhichi, 2002). The book edited by Dehling et al. (2002) contains also two other articles 
on empirical spectral processes, concerned respectively with uniform results for Gaussian processes (Dahlhaus 
and Polonik, 2002) and long range dependence processes (Soulier, 2002). Tails of the variables and measures of 
entropy need to be controlled as this is usual for empirical processes (see the paper by Dedecker and Louhichi 
in the same monograph); we do not have such assumption to the price of very specific Hilbert type classes. An 
important feature is the fact that assumption s > ^ is the best possible assumption for empirical CLT in order 
that the corresponding Dudley entropy integral converges. Uniform theorems on Hilbert classes are indeed 
usually weaker results as stated in several works of Suquet (sec for instance Oliveira and Suquet, 1998); using 
De Acosta (1970) 's criterion, entails that essentially the same assumptions that those ensuring fidi convergence 
usually implies functional uniform convergence in Hilbert spaces. 

Examples of time series satisfying Theorem 2. This theorem is first applied to 3 classical examples 
of time series, which extend the known multidimensional CLT for integrated periodogram. Then, the UCLT is 
established for a very rich class of causal time series, the ^-weakly dependent processes. 

1. Causal linear processes: let X be a linear and causal time series such that A„ = X^fcLo '^k Cn-fe for 
n € 7j, where (^fe)fcez is a sequence of zero mean independent identically distributed random variables 
such that E^o < oo- Assume also that the real sequence (a^) satisfied ^^kal < oo and J2k I'^k] < oo 
(these conditions are weaker than those of Mikosch and Norvaisa, 1997, which arc k^/'^+^ af, < oo with 
e > 0, but the considered hmction spaces in both the UCLT are different). Thus X satisfies assumption 

oo 

M and from Rosenblatt (1985, p. 59), we have for all ^ e N, ^ ||E {Yk,e \ Be)\\2 < oo and thus (7) is also 



satisfied. Then the UCLT (9) holds. 



fe=0 



2. Gaussian processes: let the sequence (X„)„gz be a zero mean stationary Gaussian process such that 
X]fc R{k)^ < oo. Then X satisfies Assumption M for all ^ e Z and k E N, and, with the cr-algebra defined 

by (6) form = A: + £, |E (Fq.^E (n,^ | TW^'^)) | = \^¥.{XoXeXkXk+e) - Ri£f\. But 

E (XoXiXkXk+e) - R{lf = R{kf + R{k + £)R{k - £) 
for a zero mean stationary Gaussian process. Thus, 

^ |E {Yo,eE {Yk,e \ M^^^)) \ < ^ R{kf + (j^ ^'(^ + ' f E ^'^^ ' ' 
fc>o fcez Vfeez / Vfcez / 

from the Cauchy-Schwarz inequality for £^ sequences. Therefore the UCLT (9) applies and the assumption 

(Sfc Rik)^ < oo) seems to be sharp in this case. 

3. Strong mixing processes: here, we consider the probability space (r2,T,P). 

Corollary 1 Let X — (A„)„gz be a sequence of random variables on (0,T, P) satisfying Assumption M. 
Assume that X is a a' -mixing process, i.e. 



a'n = sup \ a(a{Xn, Xn+e) , Bo)\ — > 0, 

^>g L \ /J n— >cx) 

where a(A, b) = sup P(^nB) -F{A)F{B) for A,B C T. Moreover, with Qix\ denoting the 



quantile function of \X\ and a' ^{u) — ^^-^«<a;,; assume that / a' ^(u)Qj^^^|('u) < oo. Then the 

u^n Jo ° 



k>0 

UCLT (9) holds. 



RemEirk We note that < Q!„ = a(a{Xk, k>n), Bq^ the standard mixing coefBcient in Rosenblatt 
(1985). However, no simple counter example seems to be available. Therefore, if X is a strongly a-mixing 

process satisfying Assumption M such that / {u)Qfxg,{u) du < oo, the UCLT (9) also holds. 

Jo ° 

4. Causal 0-weakly dependent processes: Doukhan and Louhichi (1999) introduced the class of 0-weakly 
dependent this notion was developed later on in Dedecker and Doukhan (2003). It includes numerous 
kinds of causal times scries, for instance the strong mixing processes (see other examples in Section 3). 
First, for ft, : R" ^ R an arbitrary function, with m G N*, denote 



Lip/i = 



sup 



I Hvi^ ■■■,yu)- h{xi, ...,Xu)\ 



(yu-,y^mxu...,x^) \Vl-Xi\^ h 



u '^U 



The time series X = (X„)„£z is said 0— weakly dependent when there exists a sequence (^r)reN converging 
to such that for all r e N, all function / : — > M satisfying ||/||oo < 1, and all random variable Z & Bq 
such that \\Z\\oo < 1, 

|Cov(/(X,-,,X,J,Z)| <2-Lip/-^, foraU ji,i2>r. (10) 

Let us denote \\X\\^ = (EIXI™)!/™. 

Corollary 2 Let X = (X„)„£z a 9— weakly dependent process satisfying Assumption M. We also suppose 
that there exists m > 4 such that H-'^ollm < oo and ^ S'^^ < oo. Then the UCLT (9) holds. 

k=0 

2.3.2 UCLT for non-causal weakly dependent time series 

^From the seminal paper of Doukhan and Louhichi (1999), a second class of weakly dependent processes can 
be considered. This class includes also non causal time series. A process X = {Xn)nez with values in R'' is a 
so-called 77— weakly dependent process if there exists a sequence (?7r)reN converging to 0, satisfying 



Cov (^gi{Xi^,. . .,X,J,g2{Xj^,. . . < (M(Lipgi)||52||oo + -y(Lip52)||5i||oo) 



rjr 



(11) 



for all < 



• {u,v) G N* X N*; 

• (h, ...,«„) G Z" and (ji, . . G Z'" with ii < ■ ■ ■ < iu < iu + r < ji < ■ ■ ■ < jv 

• functions gi : R"<* ^ R and 32 : R'"^ ^ R satisfying 

llflilU < 00, II52II00 < 00, Lip 51 < CO and Lip.g2 < 00; 

As a particular case of the functional limit theorem presented in Bardet et al. (2005) a UCLT for integrated 
pcriodogram can also be established, and more precisely a convergence rate to the Gaussian law 

Theorem 3 Let X = {Xn)n& be rj-weakly dependent process and such that assumption M holds. Suppose also 
that 

3 ; — ). 

m — 4 / 



Then the UCLT (9) holds. Moreover, for cj) : 
3, and for g gHs 



m - 4 

a C^(R) function having bounded derivatives up to order 



E 



(l)[V^{Jn{g) - Jig))) - </'(7(5) • <C- lTiT;r+T+^j 



where C >0,t= ({2a — — ^ - l) A (s - ■^)), A/' ~ A^(0, 1) and 7^(5) = T{g,g) defined in (5). 



CoroUciry 3 Under the same assumptions as in Theorem 3, for £ e Z and • 
bounded derivatives up to order 3, 



a (R) function having 



E 



(/)(^^(i^„(£) - Rii))) - <p{ae ■ N) 



a(m-4)-2m+l 
< C • n" 2(m+l+a.m) ^ 



with C > 0, Af ~ Af{0, 1) and 

cos2(A^))/2(A)dA-|-27r / / cos(A^) cos(/if)/4(A, -/i, M)c^Ac//i. 

-TT J —TT J —IT 



Remark The convergence rates in both the functional limit theorems in Theorem 3 and the Corollary 3 

are obtained by using Bernstein's blocks method. Even if the conditions arc perhaps not optimal wc derive 
convergence rates in those theorems with A < 1/2. This A could be made as close to 1/2 as one wants by 
taking s and a large enough. 



3 Applications to parametric estimation 

Now we will apply the previous results to finite parameters estimates. Let X = {Xn)nei, be a time series 
satisfying Assumption M. We denote by / the spectral density of X. Define 

a' = exp(J- j\ogf{X)d\j . (12) 

Following Rosenblatt (1985) we shall assume that the one-step prediction error variance satifies 2'jTa'^ > 0. 
Assume that / belongs to the family of functions defined in the form 

/(A) = /(/3,a=)(A) = ■ g^iX) for all A e [-tt, 7r[, (13) 

the function / thus depends on a finite number of unknown parameters, a variance term cr^ and a M^-vector 
P, where /? = (/3^^\ . . . , P^^^). The normalization condition (12) implies: 



/ logg0{X)dX = O. 

J —IT 



(14) 



Denote also a* and !3* = {iS^^^* , . . . , /3'^''^*) the true value of a and l3. As a consequence, for all A S [— tt, 7r[, we 
will now denote c*^*//?* (A) the spectral density of X. We will also consider the following conditions 

• Condition CI: the true values a* and /3* are such that a* > and (3* lies in a region IC cMP where /C is 
an open and relatively compact set. 

• Condition C2: if /3i, P2 are distinct elements of fC, the set {A G [— 7r,7r[, g/3i{X) ^ ff/32(A)} has positive 
Lebesgue measure. 

• Condition C3: for all P & fC, the function A 1-^ gs^{X^) = — ttt G 'Hg and sup < 00 with s > 1/2. 

5/3 (A) /3elC 

• Condition C4: for all A € [— tt, 7r[, the function /? 1— > (A) is continuous on /C. 

• Condition C5: for all A € [— tt, 7r[, the function /3 1-^ ffJ^(A) is twice continuously differentiable on /C and 

/TT 
log(5/3(A)) dX can be differentiated twice under the integral sign. 
-TT 

Condition C6: there exists s > 1/2 such that for all /? e /C and (i,j) G {l,...,p}, the functions 

< 00. 



Condition C7: for all /3 e /C, the function A g^iX) is continuously differentiable on [— tt, tt 



Let {Xi, . . . ,Xn) be a sample from X. As usually, define Whittle's maximum likelihood estimators of /3* and 
a*^ as: 

^„ = Argmin^gx: { -^n (5^ ^ ) } = Argmin^^^ | y dX | and = ^ J„ {g£ ) 

(/3n is supposed to be uniquely defined). In the following paragraphs, we will show the strong consistency of 
the estimators /?„ and a^. 



3.1 Asymptotic properties of Whittle's parametric estimators 
Theorem 4 Let X satisfy the assumptions of Theorem 1. Under Conditions Cl-4, then 

^ a. a. r,* J ^2 o-s- *2 

Pn — > P o.nd (T„ — > a . 

n — >oo n — ^oo 

Proof. From Theorem 1 and Condition C3 with probability 1, 

hm Jn{9B^) = J{gB^), 
n— >(X) ^ 

uniformly on /? S /C. From Conditions C2 and normalization condition (14), 

J(ff^i) > 2na*^ = J{g-p}) for all /3 ^ /3* 
(see Lemma 2, in Hannan, 1973). Therefore (see the details of the proof of Theorem 1 in Hannan, 1973), 
= Argmin^g;^ {■^"(fl'^^)} converges a.s. to /?* and al = -^Jnigj^) converges to ct*^ = -^Jig^^)- I 

RemEtrks on the conditions Cl-4 The CI and C2 conditions are usual and can be found for example 
in Rosenblatt (1985) for mixing time series or in Fox and Taqqu (1986) for strongly dependent times series. 
The condition C4 is weaker than the condition of differentiability generally required. It thus necessitates the 
unusual condition C3 related to the uniform limit theorems 1 and 2. 



Theorem 5 Let X satisfy either the assumptions of Theorem 2 or those of Theorem 3. Under Conditions 
Cl-6 and if the matrix W* = {w*j)i<ij<p, with 



is nonsingular, then 

with a matrix Q* = {Qij)i<ij<p whose entries are defined by 

/4(A,.,-.)(^);A)(|^)^(,).Ad; 



(15) 



■K J — TT 



Proof. Let Un{/3) = Jn{gp^). From Conditions 2 and 5, /3 i— > Un{(3) exists and is twice differentiable on /C. 



Denote 'Q^^niP) the vector 



UniP) 



According to the mean value theorem. 



52 

and '^ff^^niP) the (pxp) matrix 
i<i<p ^P 



92 



a/3 W a/30 



■C/n(/3) 



l<i,j<p 



dp 



dp 



a/32 



where ||/3„ — /3* \\p < ||/3„ — /3* ||p (with || denoting the euclidian norm in W). Since /3„ minimizes /3 1— > Un{P), 
it follows that 



|t/„(r) 



52 _ ■ 



iPn-p*). 



(16) 



But, from Theorem 4, /3„ /3* and then /3 /3*. Consequently, from Condition C5, C6 and Theorem 1 

n — *oo n — ^00 

(Uniform Law of Large Number) , 



dp- 



:UniPn) 



52 



g^}{\)-a*^g0,{X)dX 



1<2 j'<p 



(see Lemma 3 of Fox and Taqqu, 1986). Moreover, from Theorem 2 and Condition C5, 

and thus ^—UniP*) AAp(0,g*), 

op n— >(X) 



because -^JiOp^) = J ■ ^*^9P'Wd\ - a^^A (^j \og{g-\\)) dX^ = from C6 and 

(14). Therefore, if the matrix W* is nonsingular, from (16), 



^/^{Pn-n -(a*)-2(W*)-i-^p(0,Q*), 

n— ^oo 

and this completes the proof of Theorem 5. | 

Theorem 6 Let X satisfy either the assumptions of Theorem 2 or those of Theorem 3. Under Conditions 
Cl-7, then 



AA(0,2a*4 + 27r / / fi{\ ix,-ii)gp}{X)g-^}{^i) dXd^) . (17) 

J — TT J — TT 

Moreover, ~ *^*) ^'^^ V^iPn — /?*) o,re jointly asymptotically normal with covariance given by 

lim ^(CovidlJ^^y)) 

n— >oo V / l<i<p 

Proof. The Taylor's formula implies that 

with probability 1, and with — /?*||p < ||/3n — /3* From previous Theorem 5, it follows 

Under condition C7, E^C/„(/?*)^ = cr*^ + 0{logn/n) (see for instance Rosenblatt, 1985, p. 78) and thus 
V^(Unm-E(u„{P*))) J^(o,T{g^,\g^})) withg^^eHs. Therefore, 

V^{Un0n) - <r*^) ^ AA(o, r{g^,\g^})) , 
which implies relation (17). The end of the proof follows the same arguments as in Rosenblatt (1985). | 

3.2 Examples of Whittle's parametric estimates for different time series 
Causal GARCH and ARCH(oo) processes 

The famous and from now on classical GARCB.{q' ,q) model was introduced by Engle (1982) and BoUerslev 
(1986) and is given by relations 

Xk = Pk- Cfe with pl = ao + ^ CLj^k-j + XI ^oPk-j^ (18) 

where {q' . q) G N^, oq > 0, aj > and Cj > for j G N and (^fe)fegz arc i.i.d. random variables with zero mean 
(for an excellent survey about ARCH modelling, see Giraitis et al., 2005). Under some additional conditions, 
the GARCH model can be written as a particular case of ARCH(oo) model (introduced in Robinson, 1991) 
that satisfies 

oo 

Xk = Pk- £,k with pl = bo + J2 ^jXl-j , (19) 

with a sequence {bj)j depending on the family (aj) and (cj). Different sufficient conditions can be given for 
obtaining a m-order stationary solution to (18) or (19). Notice that for both models (18) or (19), the spectral 



density is a constant. As a consequence, the idea of Whittle's estimation in the GARCH case (see BoUerslev, 

1986) is based on the ARMA representation satisfied by {Xl)kei. Indeed, if {Xk) is a solution of (18) or 
(19), then (AT^) can be written as a solution of a particular case of equation (21) of bilinear models below (see 
Giraitis et al, 2005). More precisely, 

cc oo 

Xl = (7 . 6o + 7 E ^^-^fe-i) + • &0 + Al 5] bjXl_. for k G Z, 

i=i i=i 

with Sk = (Cl — Ai)/7 for fc G Z, Ai = E^q and 7^ = Var(^o). Moreover, the time series (yfc)fcez defined by 

00 

Yfe = X^ — Al • 60 ■ (1 — Al bj) for fc e Z, satisfies the forthcoming equation (21) with parameter cq = 
(as in Proposition 2 below). Hence, a sufficient condition for the stationarity of {X^)hez with ||Xo||to < 00 is 

(INU + i)-El^.l<i ^ (M^^-^ + i)-El^.l<i- 

i=i ' i=i 

Let {Xk)k&z a stationary solution of (19) and taking /3 = (/?(i), . . . ,/3(^')) € M^' such that 6^ = bj{/3) for j e N, 
and C7^ = IE(Ao — Pq) = 6o(/3) ' h{Xi,^, J2'jLi where /i is a positive real function, the spectral density of 

(^fe)fcez is 

2 00 _2 

/(/3,<^^)(A) = |^-|l-E^^(/^)-^''1" • (20) 
Then a Whittle's estimate can be used for estimating /? and cr^ parameters in ARCH(oo) process: 



Proposition 1 Lei X be a stationary ARCH(oo) time series following equation (19), such that there exists 
m > 8 satisfying E(|^o|™) < oO; satisfying the stationarity condition, 

( (~n72 — \ iT^^ "'"^) ll^ollm)' E ^ ^'^^ ''Z following assumptions 



• Geometric decay: Vj G N, < 6j(/3) and B/j. g]0, 1[ such that bj{j3) = 0{fj, ■'); 

2fii — 9 

• Riemannian decay: \/j € N, bj{f3) >Q,3v> — such that bj{(3) = 0{j~'^). 

tn — 8 

Then, under Conditions Cl-7, the central limit theorems (15) and (17) holds. 

Corollary 4 // there exists m > 8 such that X is a m-order stationary GARCH(q', q) time series satisfying 
equation (18), then with (3 = (ai, . . . , a^, ci, . . . , c,/), the central limit theorems (15) and (17) are satisfied. 

Proof. First, Doukhan et al (2005) have shown that ARCH(oo) processes satisfy the ^-weak dependence prop- 
erty: in the "Geometric decay" case, Or = 0{er'^'^) with c > and in the "Riemannian decay" case, with 
V > 2^ Or = C'(r^'^+^). Now by applying the following Lemma 6 (see section 5) for h{x) ^ x^ and thus a — 2, 

we deduce that (X^)fegz is a ^^^^^-weak dependent time series. Hence, by denoting 0' = {0'^)k& the weak 
dependent sequence of X"^ it holds: in "Geometric decay" case 6'r = 0{e~'^^) with c > and in the "Rieman- 
nian decay" case, O'r = 0(r ). Corollary 2 implies that 1/ in the "Geometric decay" case, for all /x, 
(A|)j.g2 satisfies the Uniform CLT (9), 2/ in the "Riemannian decay" case, (A^fe)feez satisfies the Uniform CLT 

-r (/^-l)(m-2) m/2-4 ^ . 2m - 9 

(9) if '-^^ ■ — - > 1, I.e. V > -. 

^ ' m-1 m/2-1 m-8 

cr2 |l-S^^iCje'J'^|2 

Finally, for GARCH(q'',g) the spectral density is explicit f{p^a2){\) = — f-r — --r-^ and 

satisfies conditions Cl-7 (more precisely conditions C3, C6 and C7 using Tig with s > 1/2 are checked). Then, 
the proof of the corollary is a special case of the " Geometric decay" case. | 



Remark Zaffaroni (2003) studied the question of the Whittle's estimation of the parameter of a stationary 

sokition of (18), this result was improved later on by Giraitis and Robinson (2001). In this paper, the conditions 
to assure the asymptotic normality of the Whittle's estimate are better than our Theorem (1), in two senses: 
1/ only the m = 8 is required; 2/ the conditions on the sequence {bj{P)) in the general case of ARCH(oo) 
model arc only 6o(/3) > and bj(f3) > for j E N* and the stationarity condition HCoHm ' Ej^i l^i(/5)| < 1- 
However, their method for establishing the central limit theorem for the periodogram is essentially ad hoc 
and can not be used for non causal or non linear time series. The recent book of Straumann (2005) also 
provides an up-to-date and complete overview to this question. Chapter 8 of this book exposed the results 
of Mikosch and Straumann (2002) that considered the case of intermediate moment conditions of order > 4 
and < 8 only for special case of GARCH(1,1) processes. The convergence rates are slower than the present ones. 



Causal Bilinear processes 



Now, assume that X = {Xk)ke2. is a bilinear process (see the seminal paper of Giraitis and Surgailis, 2002) 
satisfying the equation 

oo oo 

Xk=^k(ao + '^ajXk-j^ +co + '^CjXk-j for e Z, (21) 

where {^k)kei^ s-rc i.i.d. random variables with zero mean and such that |lCo||m < +oo with m > 1, and aj, cj, 
j G N are real coefficients. Assume co = and define the generating functions 

G{z) = (1 - C(z))-i = Er=o 9iZ' H{z) = A{z)G{z) = j:T=i h^zK 

If llCollm • Ejli < fo'^ instance when ||Co||to • (^Ejli + Ejli < 1 (^^^ Giraitis and Surgailis, 
2002), there exists a unique zero mean stationary and ergodic solution X in L'"(f2,^, P) of equation (21) (see 
Doukhan et ai, 2006). For m > 2, the covariogram of X is R{k) = ■ H^olb • — Ejli Ejlo 9j 9]+^ 

and satisfies Efe 1-^(^)1 < oo- If we assume that there exists (3 = {(3^^\ . . . , (3^^^) such that for all fc e Z, 
o-k = afc(/?) and Ck = Ck{(3), the spectral density of X exists and satisfies 

9 / /j \ 9 oo oo 



J = i JKI^/J k=-<xj=0 

with (T^ = II Co II 2- Like in Doukhan et al. (2006), we consider three different cases of the convergence rate to zero 
of the sequences (a^) and (c^). Then, using the previous results for 0-weak dependent time series, Whittle's 
estimate of parameters /3 and cr^ satisfies the following proposition 

Proposition 2 Let X be a stationary bilinear time series satisfying equation (21) with cq = 0, EdCol"*) < oo 
with m > 4 and such that ||Co||to • ^Ejli kjl + Ejli kjl) < I- Moreover, assume that X satisfies one of the 
3 following conditions 

• Finite case: 3 J e N such that Vj > J, aj{p) = Cj{(3) = 0; 

• Geometric decay: Bfj, e]0, 1[ such that Ej |cj(/?)|/U~-' < 1 and Vj e N, < aj{(3) < fi^ ; 

2ui — 5 

• Riemannian decay: Vj € N, Cj(/3) > 0, and 3ui > — — such that aj{(3) = 0{j~'^^) and 3i/2 > such 



that Ej Cj{f3)j^+''^ < oo, with < 



1^2 > 



m — 4: 
(m - 4)6 



(m - 1)^-^ - 4)log2 



= log 1 + . > log2 ■ 



E,c,(/3).f+''^^ ^ (m-l) 
Then, under Conditions Cl-7, the central limit theorems (15) and (17) holds. 



Proof. Doukhan et al. (2006) studied the three different cases of the Proposition and deduced the 0-weak 
dependence behavior of X in each case. In the "Finite" and the "Geometric decay" cases, Or = Oie-"^) with 
c > 0, which implies the conditions required in Corollary 2. Therefore, under Conditions Cl-7, the models 
satisfy the central hmit theorems (15) and (17). 



In the "Riemannian decay" case. 6,- = o( (- )'^^ with d = max ( — (ui — 1) : —- — ^ ^ . The CLT (9) 

VMogr'^ / \^ V 1 s + U2-iog2J ^ ' 

771 — 1 TTl — 4 Z/2 ' ^ — 4 

holds, from Corollary 2, whenever d ■ < —1. Thus, if 1 — z/i < and — < , 

m — 4 m— 1 + U2 ■ log 2 m — 1 

'2,Tfi — 5 (777 — 4)o 
i.e. ui > and 1^2 > 7 , ^ " --; . the assumptions of Corollary 2 hold true, and under 

TO — 4 (to — Ijd — (to — 4) log2 

Conditions Cl-7, the central limit theorems (15) and (17) are also satisfied. | 
Non-causal (two-sided) linear processes 

Let X be a zero mean stationary non causal (two-sided) linear time series satisfying 

00 

Xk= ajik-i for fc e Z, (22) 

j=-oo 

with {ak)kei € ^ and (^fc)fcez a sequence of zero mean i.i.d. random variables such that ]E(^q) = tr^ < 00 and 

EdCoD < 00 with TO > 4. We assume that there exists (3 = (/?(^\ . . . , /S^^)) such that for all fc G Z, Ofe = ak((3). 
Moreover, we assume that {ak{(3))kez is such that ak{P) = 0{\k\~'^) with a > 1. Therefore the spectral density 
of X exists and satisfies 

2 °o 
k=—oo 



Then the results of the previous paragraph concerning non causal weak dependent processes can be applied. 

Proposition 3 Let X be a linear time series satisfying (22) with {ak{P))kei. ^ ^^d. {^k)kei. ^ sequence of 
i.i.d. random variables with zero mean such that E(^q) = and Ed^ol™) < c>o with to > 4. We assume that 
(afc(/3)) is such that 

afc(/3) = 0(|/c|-«) with a>max{I; 

Then, under Conditions Cl-1, the central limit theorems (15) and (17) are satisfied. 

Proof. A 77-weak dependence condition for non causal linear random fields could be found in Doukhan and 
Lang (2002, p. 3); under the previous assumptions, X is a rj-weak dependent time series with the relation: 

r]2j. = flfc(/3)) ==> Vr = 0( g^_i/2 )' Proposition 3 is then a consequence of Theorem 3. | 

|fe|>r ^ 



RemEirk 1/ The Condition C7 of central limit theorem (17) is automatically satisfied by the convergence 
rate of (afc) and therefore is not required in Proposition 3. 

2/The especial case of ARMA process i.e. f(/3^a^){X) = l^^fixjP, with A and B polynomials 

q p 

A{z) = J2akz\ ao^O, B{z) = J2bkz'', bo = 1, 

k=0 k=0 

without zeros in the circle and with no common factors, is interesting. We have /3 = {ciq, .... Oq, bo, ... , bp) 
(Rosenblatt, 1985 page 206) and could be computed by using Jessen formula's. A factorization as in (13) is 
then possible. In this setting conditions Cl-7 are readily checked. 

3/ To our knowledge, the known results about asymptotic behavior of Whittle's parametric estimators for 
non-gaussian linear processes are essentially devoted to one-sided (causal) linear processes (see for instance, 
Hannan, 1973, Hall and Hcyde, 1980, Rosenblatt, 1985, Brockwell and Davis, 1988). In such a case, the con- 
ditions on (a/c) are Conditions Cl-6, with: J2k kal < 00 for the UCLT and the existence of J2k ^afee"**^^ for 
Condition C7. It holds true if m = 4 and Uk = 0{\k\~"') with a > 2. 

4/ There exist very few results in the case of two-sided linear processes. In Rosenblatt (2000, p. 52) a 
condition for strong mixing property for two-sided linear processes was given, but some restrictive conditions 
on the process were also required for obtaining a central limit theorem for Whittle's estimators: the distri- 
bution of random variables ^fc has to be absolutely continuous with respect to the Lebesgue measure with a 
bounded variation density, m > 4 + 2(5 with 6 > and the central limit theorem is obtained by using a tapered 
periodogram, under assumption a;4,(X)(TO)''/(^+'^^ < 00. Here CK4jOo(?Ti) ^ Oitji denotes a. strong mixing 



coefficient defined now with four points in the future instead of 2 for a^, the same remark foUowing Corollary 1 
still holds. The case of strongly dependent two-sided linear processes was also treated by Giraitis and Surgailis 
(1990) or Horvath and Shao (1999), however with more restrictive conditions than Conditions Cl-6 and with 
ak = C»(|fc|-") for a fixed -1< a < 0. 

5/ In the case of causal linear processes, it is well known that 

n— >(X) 

is a consistent estimate of a*, and \/n(0n — P*) and \/n{a^ — a*) are asymptotically normal and indepen- 
dent. 

Non-causal Volterra processes 

A zero mean and non causal process X = {Xt)t^z is called a non-causal Volterra process, if it satisfies 

Xk = ^Yk''^^ with Y^^^= Yl <^h,-,jAk-n--<k-j,, (23) 

P=l 31 < 32 < ■ ■ ■ < jp 

31 , • . ■ , 3p e z 

where ((iji,...,jp) S M for p e N* and {ji,---,jp) € Z^', and (^fc)fcez a sequence of zero mean i.i.d. random 

variables such that E(^q) = cr^ < oo and E(|^o|™) < oo with m > 4. Such a Volterra process is a natural 
extension of the previous case of non-causal linear process. From Doukhan (2003), the existence of X and thus 
the stationarity in relies on the assumption 

oo 

Yi 12 ictji,-,>r'ii^oii^ <oo. 

p=0 31 < 32 < ■ ■ < 3p 

31 Jp € 2 

Assume that there exists = (/?(^', . . . , /J^p') such that for aU p £ W and (ji,...,jp) € Z^, aji,...,jp = 
ciji,...,jp{P)- Then the spectral density of X exists and satisfies 

oo / 2\p oo 

fi0,<r^)W = E ^ E E <^h,-jAP) ■ a^i+K..,jp+m ■ e-'^^ 

P=l fe= — oo 31 < 32 < ■ ■ ■ < 3p 

31,--,3p e z 

(this formula is provided by the computation of the covariances of X; remark that the representation with 
strictly ordered indices ji < j2 < • • • < jp is fundamental) . Certain conditions on the asymptotic behavior of 
the coefficients aji,...,jp{P) give the ry-weak dependence property of X and then the asymptotic normality of 
estimators (0n,^n) 

Proposition 4 Let X be a non-causal zero mean stationary Volterra process satisfying relation (23) where 

fcgz a sequence of zero mean i.i.d. random variables 
such that E(^o) = cr^ < oo and Ed^oP) < oo with m > 4. 

Moreover, assume that the process is in some finite order chaos (i.e. aji,...,jp(/3) = for p > po) and 
aji,...,jp{l3) is such that 

^oi,-,jpi(^) max {Ijil""}) with a>4-|-max|0; — — 

Then, under Conditions Cl-7, the central limit theorems (15) and (17) are satisfied. 

Remark A sharper dependence assumption is rjr = O^r^""^ where a is submitted to the same restriction 
as before; recall that 



7.<2E E 4L..JI?o||J<oo 



fc=l 3\ < 32 < ■ ■ ■ < 3k 

31 < —'r/2, or jj^ > r/2 



Proof. From Doukhan (2003), under the previous assumptions, X is a weakly dependent process with 

^r<E E 41.JI^0||?<OO ^ ,. = 0( ). 



P=l 31 < 32 < ■ ■ < 3p 

31 < or jp > r/2 



Proposition 4 is then a consequence of Theorem 3. | 
Non-causal linear processes with dependent innovations 



Let X = {Xn)nefi be a zero mean stationary non causal (two-sided) linear time scries satisfying equation 
(22) with a dependent innovation process. More precisely, let {£,n)n& be a weakly dependent fourth order 
centered stationary process verifying Assumption M and such that ]E(^o) = cr^ < oo. Assume that there exists 
/? = (/3(^\ . . . , P^P'^) such that for all fc G Z, at = afe(/3) with ak{(3) ^ 0(|fc|-") and a > 1. Denoting g{p,a^) the 
spectral density of the process {£,n)n&^ the spectral density of X exists and satisfies 



/(/3,<t2)(A) = g(/3,a^){X) 



ak(f3)e 



For instance, the process (Cn)nez may be a causal or a non-causal ARCH((X)) or bilinear process. Following 
the results of Doukhan and Wintenberger (2006), if (^n)n£Z is a ry- weakly dependent process, then X is an 
r/-weakly dependent process (with a sequence {rir)r that can be deduced). Thus, the asymptotic normality of 
the Whittle estimate of parameters (/?, tr^) could be established 

Proposition 5 Let X be a linear time series satisfying (22) with {ak{(3))kGZ € and {ik)kei a rj'^^'' -weakly 
dependent process with zero mean, a spectral density g{i3,a^) depending only on parameters (/3,(T^), and such 
that E(^^) = and Ed^ol") < oo. Moreover, we assume that 

akm=0{\kr), r?«) = ©(r-"), with 6 • > max {s ; |;^}. 

Then, under Conditions Cl-7, the central limit theorems (15) and (17) are satisfied. 

Proof. Doukhan and Wintenberger (2006) proved, under assumptions afe(/3) = 0(|fc|~") and r]^^ = 0(r~*), 

(a-2)(Tn-2) \ 

r ' (a-i)(m-i) j . Proposition 5 is then a consequence of 

Theorem 3. | 

4 Appendix: proofs 

4.1 Proof of Theorem 1 

Lemma 2 If X satisfies Assumption M, then 

n ■ max Var (^Rn{i)^ ) < m + 27. 

Proof of Lemma 2. To prove this result, we use the identity 

Gov {Yo,e, Y,,,) = Ki{l,j,j + £) + R{3f + R{j + i)R{j - £), 
and deduce from the stationarity of {Yj^e)j^z when £ is a fixed integer 



n- Var (]?„(£)) < ^ ^ ^ | Gov (F,- ^ , 
j=iv(i-£) j'=iv(i-^) 

< 5^|Cov(yo,^,is-,)| 



< ^(|K4(^,i,i + ^)|+2i?(i)2) 

< Ki + 27, 



by using Gauchy-Schwarz inequality for ^^-sequences. 

Lemma Z If X satisfies Assumption M, then 

3 



E|| Jn — J\\t-i' — ~(l + Cs ■ (k4 -|- 27)") , where Cg is defined in (2). 



Proof of Lemma 3. Let g{X) = ^£^i9i^ € W^. As in Doukhan and Leon (1989), we use the decomposition 



Jnia) - J{9) = -Ti{g) - T2{g) + ^{g) with { 



\l\>n 



T2{g) = - \^\Ri^)9i, 

n ^ — ' 

K|<n 

T^M= ^(iinW-IEi?nW)j 
\t\<n 



Remark that T^^ig) = Jn{g) — ^Jn{g)- Thus, we obtain the inequahty 

Eii j„ - jf^, < smr^, + \\T,r^, + nTsfn^). 

Cauchy-Schwarz inequahty yields 



\e\>n 



'\>n 



\e\<n 



Hence, ||Ti||^, + ||T2||^, < -. Lemma 2 entails 



\£\<n 



n 



< 



Ed 



(i?„(^)-Ei?„(£))2, 



\t\<n 



nm\k < E (1 + 1^1)"'^ var (^ffl) < ^ E (1 + i^i)"'^ (^^ + ^ '^^""'^^ ■ 

K|<n K|<n 

with Cg defined in (2). We combine those results to deduce Lemma 3. 



(24) 



Proof of Theorem 1. Wc prove this strong law of large numbers from a weak L^-LLN and Lemma 3. The 
scheme of proof is analogue to the one in the standard strong LLN in L^. Set t > Q. First, we know that for 
all random variables X and Y, we have V {X + Y >2t) {X >t) + V {Y >t). Thus 



)CSO 
< V P(||Jfe2 - J||„, >t) 

, T>-, 



k=[-/N] 

+ V P( sup ||J„- Jfc2||„, >i) 

< Am + Bn. (25) 
^From Bienayme-Tchebychev inequality. Lemma 3 implies that 

^^^^•Ep' (26) 

k>-/N 

with Ci e IR+. Now set Rn{() = Rn{() — IE-R„(^). The fluctuation term Bn is more involved and its bound is 
based on the same type of decomposition as (24), because for fc^ < n 

Jn{9) - JM = -T[{g) + n{g) - T^{g), 
with now T[{g) = ^ R{t) g^, 

K^<\l\<n 

^2(5) = ^ E \^\m9e, 

k'^<\l\<n 

and T^{g) = ^ Rk^{l)ge- ^ Rn{i)ge. 
K|<fe2 \e\<n 



As previously, ||Ti'||2,, + ||r^||2^, < ^. 

Set Lfe = ,^^max ||J„ - JkA\n', and = ,^^niax ||T;^||h'^. Then, 

Bjv < ^ with 6fe = P (Lfc > i) < 

k>-/N 



Now 



Then, for A:^ < n < (fc + 1)^ and £ G Z, 

n 

nA(n-e.) n/\(n-e) 

n ^ — ' n ^ — ' 

h=k^^^{k^^-l)) + l h=fe2A(fc2-£))+l 

Remark that Rk'^{t) = if fc^ < |£| < n and thus Rn{() = ^t.,n,k in such a case. Also note that 

^ (fe^+2/c)A((fe^+2/c)-£) 

and thus E(A,%)2 < J_ ^2kf ■ ^ max^ (Edr;.,^!^)) 



Write 



5^ 



and we thus deduce 

c-A 



nm\w, < 2c • ( p max (Var (^,. (£))) + max (E(A|,,)2) 



< 



fc2 



for a constant ^ > depending on E|Xo|^, K4, and 7 only. Hence 6^ < 8(7 + A ■ c)/{k'^t'^) is a summable series 
and, with C2 > 0, 

k>VN 



Then, (25), (26) and (27) imply sup || J„ — J\\n' what is equivalent to || J„ — J||7i' 0. 

„>jV' ° AT— >(X) ° n— >oo 



4.2 Proofs of the section 2.3.1 

First let us recall the following classical lemma (see a proof in Rosenblatt (1985) [36], p. 58): 
Lemma 4 If X satisfies Assumption M and {£, k) € 1? he arbitrary integers, then 

n- Cov{Rn{k),Rn{i)) — > Uk,e. 



Proof of Lemma 1. Under condition (7), the projective criterion, introduced in Dedecker and Rio (2000), i.e. 
E |io/i E (Yk^ii I a( Yj^^. , j < 0)^ < oo for alH e {1, . . . , m}, holds. Therefore each Rn{U) satisfies the 

fe>0 

central limit theorem. Now, by considering a a linear combination of {Yj/^ Yj^e^), denoted Zj, the projec- 
tive criterion is also satisfied by {Zj)j^z, yielding the multidimensional central limit theorem (8). | 

Proof of Theorem 2. We first prove the following lemma: 

Lemma 5 (Tightness) If X satisfies Assumption M then the sequence of processes {Zn)neN' is tight in Hg. 

Proof of Lemma 5. Following de Acosta (1970), for showing the tightness we only need to prove that the 
sequence is flatly concentrated, this means that 

E(\\pLZn\\^,J 



L- 



where pl : H'^ ^ F'^ denotes the orthogonal projection on the closed linear subspace C H'^ generated by 
{^e)\e\>L with e^(A) = e'^"^ (also Fl C Hs denote the subspace generated by (e£)|^|>i). Then, for L > 0, 



\\pLZn\\n',= sup \Zn{g)\. (28) 
llsllwa<i. a^PL 

Thus, for g = Y^^^^y.i^gte-e € Fl and HffHw^ < 1, using again the decomposition (24), we obtain 

\Zn{9)? < 3n ■ (|Ti(ff)|2 + \T,ig)\' + lUg)^ 
First, from a Cauchy-Schwarz inequality, we have 

n{\T,{g)\^ + \T,{g)\') < nl ^ {1 + \e\r'^ R{if ^ (1 + K|)'^<?| 

\\e\>n\/L \e\>n\/L 

+ hL<n}^ E \£\Hi + \£\)-''R{£r E (^ + \^\f'9l 

L<\e\<n L<\e\<n 

< n(i + |nvL|)-2« m'+^L<n} E \m + \i\r''m' 

\e\>nVL L<\e\<n 

< 7(i(l + i)-'^I{L>„} + L{1 + L)-^'l{L<n}) . 

sup n{\T,{g)\^ + \T2{g)\^) ^-^ 0. (29) 
\\9\\ns<i, geFL 



Thus, we obtain 



Also note that 

V^nig) = ^ (i?„(f) - E^„(£))r7^ 

\i\<n 

n\Ts{g)\^ < ^ E {i + \nr^%Rn{i)-'KRn{i)f 

L<\e\<n 

e( sup n\T3{g)\^) < V (1 + |£|)-2« • sup (nVar (^„ (£)))< V (1 + |£|)-2- («4 + 87). 

Since E^ez(l + l^l)"^"* < +0°' ^e deduce Ef sup n\T3{g)f) — > 0. With (29) and (28), the proof 
ends. ■ 

Now the proof of Theorem 2 can be achieved. Indeed, the tightness allows to establish the functional cen- 
tral limit theorem. Moreover, J„(g) — EJ„(5) = Sfez .9^ (-^«(^) ^ IE(i?„(^)), and therefore, from (4), the 
limiting covariance of the process {Zn)n>i is given by (5). More details of the finite dimensional convergence 
of the process {Zn{gi), . . . , Zn{gk)) can be found in Rosenblatt (1985, Corollary 2, p. 61). | 



Proof of Corollary 1. Respectively from Rio's inequality (1994) and from X's stationarity, we have, for all 



Jo 

I Q'\Y^ du. 

Jo 



< 2 

Therefore, for all A; e N, 

||yo,£E(n+,,, I < 2 / 

Jo 

Consequently, for all ^ e N 



k>0 "'O \fc>0 / 



< 2 /\a'(w))-igfy^^|(w)d«. 
Jo 

But Lemma 2.1 in Rio (2000) provides 

^ {a'{u))-^Q^y^^^^{u)du < ^ {a'{u))-^(Q^Xo\{u)QiXe\{u) + QiRie)i{u)y du 



\a'{u))-\Qfx,\{u) + \R{i)\rdu, 
and therefore if / (a'(u))"^Q|'^^| (u) < 00, then ^ ||ro.£ E {Yk.i \ Be)\\i < 00 for aU ^ e N. 

JO " u^n 



k>0 



Proof of Corollary 2. We truncate the variables Xj = fM{Xj) + gM{Xj) where, for x € M, we set fnix) = 
[x A M)y (-M) (then /m G [-M, M]) and gM{x) = x - /M(a;) satisfies |ffM(a;)| < |a;|]I^j;|>M- Note that 
Lip/M = 1 and ||/m||cx) = M. 

Then, Yk,e = (/M(^fe) fniXk+e) - i?'(£)) + t^fe,^,M with: 

• R'{£)=EfM{Xk)fM{Xk+e); 

• f/fe,£,M = 9M{Xh)fM{Xh+e) + fM{Xk)gM{Xk+e) + 9M{Xk)gM{Xk+e) + R'{i) - R{£). 

Therefore, E{Uk,e,M) = and, for m such that ||-^o||m < 00, we derive 

\\Uk,e,M\\i < ME\Xk\--S\x,\>M + ME\Xk+e\-l\x^+,\>M 

+E (dXfcl ■l^x,\>Mf) + |e {^XoXe - /m(Xo)/m(X^)) 

/ \ 1-1/m / s 1-2/m 

< 2M||Xo|U(P(Xo > M)j + \\Xo\\i[F{Xo > M)j 

+E \fM{Xo)gM{Xe)\ + E |.gM(Xo)/M(^^)| + E |ffM(^o)5M(X^)| 
'E|Xor\i-i/™ 2 /E|Xor\i-2/™ 



<6-M'-"^-\\Xo\C, (30) 
from Holder and Markov inequalities. By the same procedure, we also obtain 

\\Uk,e,M\\l < 6(Egl,{Xk)fl{Xk+i) + Eflj{Xk)gUXk+e) + '^9M{Xk)gl{Xk+e)) 

< IS-M^-^'-WXolC- (31) 



Let /iM be the function such that hM{x, y) = fM{x)fM{y) — R'{t) for all (x, y) G R^. Note that ||/im||(x) < 2M^ 
and Lip/iM = M. Moreover, for all random variable W in h^{Cl,A,F), 



||E(I^|B^)||i = sup 

zeL~(a,B^,p) , ||x||oo<i 



E{W-Z) 



Therefore, 

hM{Xo, Xi) ■ E (jiM{Xk, Xk+e) \ Be^ 



E{hMiXo,Xi) ■ hM{Xk,Xk+e) \Be 



sup 

zeL~(a,B«,p) , ||z||oo<i 



< sup 

z'ei.'^in.Bi.P) , i|z'i|oo<2Af2 



E (^Z ■ hM{XQ,Xi) ■ hM{Xk, Xk^i)^ 
Coy (hM{Xk, Xk+e), Z') ■ 

Consequently, from the inequality (10) and the stationarity of X, for all A; > 0, 

hMiXo,Xi)-E(hM{Xk,Xk+e)\Be)\\^<4-M''-ek-\e\- (32) 



Thus, 

Yo,e ■ E (Yk,e \ Be) 



< 



< 



Uo,e,M ■ E (Uk,e,M | S^) ||^ + ||/im(Xo, Xi)E (Uk,e,M \ Be) 
Uo,e,M ■ E ^hM{Xk,Xe+k) \ Be) ^ + hM{Xo, Xe) ■ E (jiMiXk, Xk+e) I Be) 



Uk. 



e,M 



Uk. 



I'M 



{Xo,Xe) ■E(^hM{Xk,Xk+e)\Be) 



from (30), (31) and (32). Set M = e\,_ 
such that 

^^l-3/(m-l) 



the previous calculations prove that, if there exists some m > 4 
< oo, and ||-'^o||m < oo. 



fe=0 



then the Uniform CLT (9) holds. 



4.3 Proofs of Theorem 3 and Corollary 3 

Proof of Theorem 3. Set g &Us with g{\) = E^ez5^e'^^ let k e N* and define g^''\X) = T.\e\<k9t^'^'^ ■ One 
obtains for all C^(M) function 4> with bounded derivatives up to order 3 



E 



^{V^{Jn{g) - J{g))) - cp{a{g) ■n)]\< d[% + Di% + ^ 



(fc) 

n' 



with 



l.n 



D. 



(fe) 



D. 



(fe) 

3,n 



E 



E 



^{MUg^"^) - Jig^'^))) 'P(^{g^'^) ■ n) 

0(a(5«).7v) -0(a(,g).7v)] 

^{V^iUg^"^) - J{g^'^))) - </>(v^(Jn(9) - J{g))) 



Term D[1: For i = 1, . . . ,n, set Xi = {Xi+e)\e\<k a stationary random vector in M^*^ ^. The function 

H^i) = XI 9e{XiXi+e - R{£)) for i = 1, . . . , n, 

\e\<k 

satisfies the assumption H (namely Eh{xo) = and there exists a > 1 and A = A{d) > 1 such as for all 
u,v e R'^, \h{u)\ < A(|m|" VI) and \h{u) - h{v)\ < A((|u|«-i + V l) \u-v\, see in [2]). Here a = 2 and 

A = A{2k - 1) = 2A; - 1. Define also 



yii'. , 



ig^"^) - Jig'"')) 



By applying Theorem 1 of Bardet et al. (2005) to this function h, one obtains with Ci > and A 

D[':l<C,.k^.n-\ 

Term D^]^: From inequahty |a — 6|<|a^ — 6^|/afora>0, 6>0, and from the mean value theorem, 



a{m - 4) - 2m + 1 
2(m + 1 + a • m ' 

(33) 



P,(fe) II0IIOO 



But, from the expression (5), we deduce 



< 



+27r r /'"(5(%(/z)-ffW(A)5('=H/^))/4(A,-M,M)rfAdM 

J —TT J — TV 



With g gHst have 



\\9 - 9^'moo < ( E (1 + 1^1)"") '^'( E (1 + inraiy^ < ( E (1 + i^d-'^'^'ii^iih.- 

Kl>fe Kl>fc W>k 



1/2 



1/2. 



Consequently, with also ||5 + 5^'=^ lloo < 2( 



-2s 



1/2 



Igll^i^, there exists C2 > such that 



C2-fc^ 



(34) 



Term d'^^: First, from a Taylor expansion. 



Dtl < \ ■ WU ■ n ■ e(j„(5 - 9(*=)) - Ji9 - 9^"^))'. 



With the same decomposition as in the proof of Lemma 3, one obtains 

,2 / / , , \2 ,\ 



E 



(^(5-fl('^)- J(5-5^'^)) < 3((E^(%^) +(- E \W)9^ + 

fe<|^|<n 

+ 1 E 9l(Rn{t)-^{Rn{l)) 



\l\>n 



k<\l.\<n 



First, 



( E ^9^ ' < (1 + n)-^« • E • E (1 + \^\f'3l < i ■ Mhs ■ E ^w'- 



Kl>n 



Kl>n 



\t\>n 



\l\>n 



Using the weak dependence of {Xi)i and with the same method as in the proof of Lemma 2 in Bardet et al. 
(2005) adapted to the function h(x) = x (therefore with a = 1), 

|ii(^)| <c- 77,1^ <c- 1^1 
from the rate r/|£| = 0(1^?!"") with a > 3. As a consequence, 



E^w 



/ \ 2 

and { E R{^)9n <c-n 



2a - 



\i\>n 



In the same way, 



E <'--\\9\\k- E R{^r<^-k'-'"- 

\ k<\l\<n I h<\t\<n 



Finally, 

2 / .5-^ / ^ \l/2\2 



II Yl 9i{Rn{i)-mn{i)))\l < ( Yl l5£l(Var(i?„W)) )' 

k<\e\<n k<\e\<n 

< max(Var(i?„W)).|iff||?,.- E (1 + I^D"''* 

k<\e\<n 

< - • (K4 + 27)- llffll^^ • E (1 + 1^1)-^^ from Lemma 2. 

fe<|£|<n 

Summing up, there exists C3 > such that 

£'£<C3-(fc^-'"^+fci-2^). (35) 

(771 — 2 \ 1 

2a j- — ij A (s — -) and selecting A; such 

that = n^, that there exists C > such that 



E 



<p(MM9) - Jig))) - ^{'Jig) ■ N 



< C ■ n *+3 



A 



Proof of Corollary 3. Set g(A) = e*^'^ in Theorem 3. Since this function belongs to each space Hs, it follows 
that the terms D2^l and D^'^l both vanish and the result follows from the bound (33). | 

5 Appendix: a useful lemma 

For a weakly dependent process, the following auxiliary lemma shows that a function of this process is also a 
weakly dependent process and moreover provides a relation between the two weak dependence sequences. For 
an example of the use of such a result, see the paragraph devoted to causal ARCH(oo) time series. 

Lemma 6 Let {Xi)i^x be a -valued and \J' -stationary time series with p > 1, h : M.'^ M. be a function 
such that \h{x)\ < c||.t||" and \h(x) — h{y)\ < c\\x — + ||2/||"~"'") for (x.y) E (M'^) . 1| • || a norm, on 

M'', with < c and 1 < a. < p. Let {Yi jit^z be the stationary times series defined by Yi = h{Xi) for i G Z. Then 

• Lf {Xi)i^z is 9-weakly dependent time series, then {Yi)i^z is a stationary 0^ -weakly dependent time series, 

p — a 

such that Vr e N, 9j = C ■ 9r~^ with a constant C > 0; 

• Lf {Xi)i^z is rj-weakly dependent time series, then {Yi)i^z is a rj^ -weakly dependent time series, such that 

p — a 

Vr e N, 7/^ = C • ?7r with a constant C > 0. 

Proof. We first assume that d — 1. Let / : R" K and 5 : ^ M two real functions such that Lip / < 00, 
ll/lloo < 1, LiP5 < 00, llfflloo < 1- Denote x^'^'> = {xAM)\/{-M) for x e R. For simplicity we first assume that 
V = 2. Let ii, . . . ,iy,,ji, . . . ,jy G 2"+" such that ii, ■ ■ ■ ,iu > r and ji, . . . , jt, < and denote Xi = (Xi^, . . . , Xi^) 
and a;j = {Xj^, . . . , XjJ. We then define functions F : R" ^ R, F(^) : R" ^ R and G : R" R, 
G(A^) : R" _> R through the relations, F(xi) = f{h{X,,),...,h{X,J), F^'^^^Xi) = f{h{x\^'>),...,h{x\^'>)) 

andG(xj)=5(M^,J,...,M^.J),GW(^j)=5(M4''^---,M^r^))- Then 

\Co^{F{x,),G{x;))\ < |Cov(F(a:i),G(xj) - GW(xj))| + \Co^ {F{x,),G^^\x;))\ 

< 2E|G(xj) - G^^\xi))\+2^F{xi) - F^^\xi)\ + \Coy {F^^\xi),G^^\x;))\. 

The last relation comes from H/Hoo < 1- But we also have 

¥.\G{xi) - G^^\xi))\ < v■UY>g■^h{Xo)-h{X^'^^)\ 

< 2c ■ V ■ Lip g ■ Ei^lXol"" ■t\Xo\>M) (from the assumptions on /i), 

< 2c • t; • Lipfii • llXollp • M^'P (from Markov inequality). 

The same thing holds for F. Moreover, the functions F^^) and G^*^) satisfy LipF^^) = LipF^^^' = c • M"-^ 
with c> 0, and ||F(^'||oo < 1, ||G(*^)||oo < 1- Thus, from the definition of the weak dependence of X 



CoY{F^^\xi),G^^\xj)) 



< CvLipfM'' ^^r) with u = 2, under condition ^; 

< C{vLip f -\- uLipg)M'^~^r]r, under condition ry. 



Finally, we obtain respectively 

|Cov(F(a;i),G(a;j))| < CvLip f [M^-^er + M^-p) 

< C{vUp f + wLip g) {M^-^-qr + M"-f ) . 

By the optimal choice of M = 6V^^~^\ we get respectively 

|Cov(/(Fi,,...,yiJ,5(Fi,,...,yiJ)| < CvUvfOp; 

p — a 

< C{vLip f + uLipg)r]r~^ ■ 

Changes for the vector valued case are simple, here truncations should only be considered componentwize and 
yield the same result up to a constant. | 

References 

[I] Ango'nze, P., Doukhan, P. (2004) Weak dependence: models and applications to econometrics. Econometric 
Theory 20, 995-1045. 

[2] Bardct, J.-M., Doukhan, P., Leon, J.R. (2005) A functional limit theorem for non causal weak 
dependent processes and its applications. Preprint of Samos, Universite Paris 1, available with 
ftp://samos.univ-parisl.fr/pub/SAM0S/preprints/samos232.pdf. 

[3] Bollerslev, T. (1986) Generalized autoregressive conditional heteroskedasticity. J. Econometrics 31, 307-327. 

[4] Brockwell, P.J., Davis, R.A. (1991) Time series: theory and methods. Second edition. Springer Series in 
Statistics. Springer- Verlag, New York. 

[5] Dahlhaus, R., Polonik, W. (2002) Empirical spectral processes and nonparametric maximum likelihood es- 
timation for time series., in Empirical Process Techniques for Dependent Data, Dehling, Mikosch and 

Sorcnscn editors, Birkhauser, 275-298. 

[6] Dahlhaus, R. (1988) Empirical spectral processes and their applications to times series analysis. Stoch. Proc. 
Appl. 30, 69-83. 

[7] Dalla, V., Giraitis, L. and Hidalgo, J. (2006) Consistent estimation of the memory parameter for nonlinear 
time series. J. Time Ser. Anal. 27, 211-251. 

[8] De Acosta, A. (1970) Existence and convergence of probability measures in Banach spaces. Trans. Am. 
Math. Soc. 152, 273-298. 

[9] Dedecker, J., Doukhan, P. (2003) A new covariance inequality and applications. Stoch. Proc. Appl. 106-1, 
63-80. 

[10] Dedecker, J., Louhichi, S. (2002) Maximal inequalities and empirical central limit theorems, in Empirical 
Process Techniques for Dependent Data, Dehling, Mikosch and Sorensen editors, Birkhaiiscr, 137-159. 

[II] Dedecker, J., Rio, E. (2000) On the functional central limit theorem for stationary processes. Ann. Inst. 
H. Poincare, Probab. Statist. 36, 1-34. 

[12] Dehling, H., Mikosch T., Sorensen, M. (2002) Empirical Processes Techniques for Dependent Data (editors), 
Birkhaauser. 

[13] Doukhan, P. (2003) Models inequalities and limit theorems for stationary sequences, in Theory and appli- 
cations of long range dependence (Doukhan et alii ed.) Birkhauser, 43-101. 

[14] Doukhan, P., Lang, G. (2002) Rates in the empirical central limit theorem for stationary weakly dependent 
random fields. Stat. Inference Stoch. Process. 5, 199-228. 

[15] Doukhan, P., Leon, J. R. (1989) Cumulants for mixing sequences and applications to empirical spectral 
density. Probab. Math. Stat. 10.1, 11-26. 

[16] Doukhan, P., Louhichi, S. (1999) A new weak dependence condition and applications to moment inequali- 
ties. Stoch. Proc. Appl. 84, 313-342. 



[17] Doukhan, P., Madre, H., Rosenbaum, M. (2006) ARCH-type bilinear weakly dependent models. To appear 
in Statistics. 

[18] Doukhan, P., Tcyssicrc, G., Winant, P. (2006) Vector valued ARCH(co) processes. To appear in Lecture 
Note in Statistics, Special issue on time series, Bertail, P. , Doukhan, P. and Souher, P. Editors. 

[19] Doukhan, P., Wintenberger, O. (2006) Invariance principle for new weakly dependent stationary models 
under sharp moment assumptions. To appear in Probab. Math. Statist. 

[20] Engle, R. F. (1982) Autoregressive conditional heteroscedasticity with estimates of the variance of United 
Kingdom inflation. Econometrica 50, 987-1007. 

[21] Fox, R., Taqqu, M. S. (1986). Large-sample properties of parameter estimates for strongly dependent 

Gaussian time series. Ann. Statist. 14, 517-532. 

[22] Giraitis, L., Leipus, R., Surgaihs, D. (2005). Recent advances in ARCH modelling. In Long-Memory in 
Economics. G. Teyssiere and A. Kirman editors, Springer Verlag (Forthcoming). 

[23] Giraitis, L., Surgaihs, D. (1990). A central limit theorem for quadratic forms in strongly dependent linear 
variables and its application to asymptotical normality of Whittle's estimate. Probab. Th. Rel. Fields, 86, 
87-104. 

[24] Giraitis, L., Surgaihs, D. (2002). ARCH-type bilinear models with double long memory. Stoch. Proc. AppL, 
100, 275-300. 

[25] Giraitis, L., Robinson, P.M. (2001). Whittle estimation of ARCH models. Econometric Theory 17, 608-631. 

[26] Hall, P., Heyde, C. (1980) Martingale limit theory and its application. Academic Press, New York. 

[27] Hannan, E. J. (1973) The asymptotic theory of linear time series m,odels. J. Appl. Probab. 10, 130-145. 

[28] Horvath, L., Shao, Q.-M. (1999) Limit theorems for quadratic forms with applications to Whittle's estimate. 
Ann. Appl. Probab., 9, 146-187. 

[29] Mikosch, T., Norvaisa, R. (1997) Uniform convergence of the empirical spectral distribution function. Stoch. 
Proc. Applic. 70, 85-114. 

[30] Mikosch, T., Straumann, D. (2002) Whittle estimation in heavy-tailed GARCH(1,1) model. Stoch. Proc. 
Applic. 100, 187-222. 

[31] Oliveira, P.E., Suquet, C. (1998) Weak convergence in ip[0, 1] of the uniform empirical process under 
dependence. Statist. Probab. Letters 39-4, 363-370. 

[32] Rio, E. (1994) Inegalites de moments pour les suites stationnaires et fortement melangeantes. C.R. Acad. 
Sci. Paris 318, 355-360. 

[33] Rio, E. (2000) Theorie asymptotique des processus aleatoires faiblement melangeants. Collection 
Mathematiques & Applications 31. Springer. Berlin. 

[34] Robinson, P. M. (1991) Testing for strong serial correlation and dynamic conditional heteroskedasticity in 
multiple regression. J. Econometrics 47, 67-84. 

[35] Robinson, P. M. (1995) Gaussian semiparametric estimation of long range dependence. Ann. Statist. 23, 
1630-1661. 

[36] Rosenblatt, M. (1985) Stationary processes and random fields. Birkhauser, Boston. 

[37] Rosenblatt, M. (2000) Gaussian and non-Gaussian linear time series and random fields. Springer Series 
in Statistics. Springer- Verlag, New York. 

[38] Saulis, L., Statulevicius, V.A. (1991) Limit theorems for large deviation. Birkhauser. 

[39] Soulier, P. (2002) Estimation processes techniques for the spectral estimation of fractional processes, in 
Empirical Process Techniques for Dependent Data, Dehling, Mikosch and Sorensen editors, Birkhauser, 
299-323. 

[40] Straumann, D. (2005) Estimation in Conditionally Heteroscedastic Times Series Models. Lectures Notes 
in Statistics 181, Springer, New York. 

[41] Zaffaroni, P. (2003) Gaussian inference on certain long-range dependent volatility models. J. Econometrics, 
115, 199-258. 



